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Abstract 

In this paper we explore the mathematical structure 
of hierarchical organization in smooth dynamical sys- 
tems. We start by making precise what we mean by a 
level in a hierarchy, and how the higher levels need to 
respect the dynamics on the lower levels. We derive 
a mathematical construction for identifying distinct 
levels in a hierarchical dynamics. The construction is 
expressed through a quotient manifold of the phase 
space and a Lie group that fulfills certain requirement 
with respect to the flow. We show that projections up 
to higher levels can be related to symmetries of the 
dynamical system. We also discuss how the quotient 
manifold projections relate to invariant manifolds, in- 
variants of the motion, and Noether's theorem. 



1 Introduction 

In this paper we look at dynamical systems that al- 
low (or do not allow) multiple simultaneous levels of 
description. The conceptual framework for this was 
outlined in a previous publication, see ^ E] . From a 
technical perspective, the first issue is to define levels 
in the hierarchy. With a definition in place we can 
seek tools that can be used to identify the levels, as 
well as maps between levels. We argue that a rea- 
sonable definition of hierarchical levels is to require 
the dynamics to be self-contained, which in the cur- 



rent presentation means deterministic, at each level 
within a hierarchy. A higher level of description is 
defined through a projective map of the degrees of 
freedom on a lower level, and the induced map of the 
dynamics. Whether, or not, a projective map consti- 
tutes a new level of description can be determined by 
studying the induced dynamics on the higher level, 
i.e., by determining whether the map induces a well 
defined flow describing a new deterministic dynamics 
with fewer degrees of freedom. 

This can be formulated in the language of differen- 
tial geometry. Assume that, on the lowest level, the 
dynamics of the system is described by a trajectory 
in the phase space space M, where M is a manifold. 
The dynamics, or the trajectory, is an integral curve 
of a vector field, the infinitesimal generator of a flow 
tpt- A transition to a higher level of description, i.e., 
a dimensional reduction, is described by a projective 
map^ TT from M to a lower dimensional manifold N. 
The central question is whether, or not, there ex- 
ists a well defined dynamics, a flow tpt, on N that 
describe the projected trajectory. We can express 
this as a commuting diagram, see Fig. ^ It should 
be made clear that the approach to hierarchical dy- 
namics, or elimination of degrees of freedom, taken 
in this paper is purely geometric. This means that 
we consider only eliminations though projections on 



^By projective map we mean a map from one manifold to 
another manifold with lower dimensionality, possibly a sub- 
manifold of the previous 
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Figure 1: The manifold M is the original phase space, 
A'^ is a lower dimensional phase space, and (f>t and '0* 
denotes flows on M respective N. The projective map 
TT describes a new level of description if the diagram 
commutes. On a more conceptual level, the diagram 
can be viewed as a definition of (a restricted type of) 
emergence. 



the phase space manifold. The projection cannot, 
for example, depend on time or on the vector field 
generating the dynamics. To make this distinction 
clear, consider a periodic orbit of a dynamical sys- 
tem. One possible viewpoint would be to state that 
the dynamics is one-dimensional. The trajectory can 
be mapped onto the circle by using the arc length 
as a parametrization. This projection is however not 
geometric, and therefore not generally acceptable in 
the framework considered in this paper. For more 
details on the periodic orbit see Section 



2 Background 



Reducing the effective dimensionality of a dynamical 
system is of interest in almost all fields of science that 
use mathematical modeling. The actual methods for 
dimensional reduction that are used in different ar- 
eas vary quite dramatically, both technically but also 
with respect to what is meant by a dimensionally re- 
duced model. Here I briefly outline three different 
approaches. 



2.1 Noether's theorem in classical me- 
chanics 

The problem of eliminating degrees of freedom in dy- 
namical systems has its longest historical legacy in 
classical mechanics, dating back to Poincare's clas- 
sic study of many body problem as well as Jacobi's 
elimination of nodes, see Arnold ,3, and references 
therein (especially 0], as well as jS]). The most el- 
egant and universal formulation of the process was 
formulated by Noethcr in her famous theorem relat- 
ing fundamental variational symmetries with (local) 
conservation laws, see e.g., .6 . For finite dimensional 
systems, a conservation law is equivalent to an in- 
variant of the motion, which in turn implies that the 
dynamic occurs on an invariant constraint manifold. 
Elimination of degrees of freedom can then, at least in 
principle, be carried out by expressing the dynamics 
in a coordinate system where the constraint mani- 
fold is trivial, i.e., where the constants of the motion 
separate from the "effective" degrees of freedom. A 
classic example is the n-body problem with conser- 
vative pairwise central force interaction. Naively this 
system has 6 • N degrees of freedom. Spatial invari- 
ance (translation and rotation) and time translation 
invariance lead to conservation of momentum, angu- 
lar momentum and total energy. The total degrees 
of freedom in the system is therefore reduced by, at 
least, 3 + 3 + 1 = 7. 

2.2 Inertial manifolds 

Central to the study of nonlinear dynamical systems 
is the identification and computation of invariant 
manifolds 13 E] , or, for infinite dimensional dissipa- 
tive driven (parabolic) partial differential equations, 
inertial manifolds ^ . The idea is that the dynam- 
ics of the system, after a short transient, approaches 
a positively invariant manifold, or an attractor|10|. 
of significantly lower dimensionality than that of the 
full system. The effective dynamics of the system can 
then be described in terms of a parametrization of the 
invariant manifold, i.e., a low dimensional represen- 
tation of the system. This scenario is often referred 
to as slaving of the fast degrees of freedom to the 
slowly varying degrees of freedom spanning the in- 



2 



variant manifold. Important for this idea to apply 
is that there exist a clear separation of time scales. 
Intuitively we can argue that the fast contracting di- 
rections in the phase space are effectively removed 
from the dynamics and the remaining degrees of free- 
dom is the attractor. For a recent overview over 
this approach to dimensional reduction, see [111 I12| . 
The general idea of slaving fast degrees of freedom 
and adiabatic elimination is also a recurring theme 
in Haken's work on self-organization 

2.3 Projection operators in non- 
equilibrium statistical physics 

In non-equilibrium statistical physics one usually per- 
forms model reduction by focusing attention on phys- 
ically interesting variables. The affect of the other, 
uninteresting, degrees of freedom is included as a 
noise in an effective stochastic differential equation, 
i.e., a Langevin equation involving the relevant de- 
grees of freedom. Similarly to the situation with in- 
variant manifolds, separation of time scales is impor- 
tant for the noise to be uncorrelated in time (white) 
and for the higher level dynamics to lack memory, 
i.e., be "Markovian" In contrast to the sit- 

uation with invariant manifolds, there are no ana- 
lytic tools for choosing the relevant degrees of free- 
dom. In practice the choices are guided by physical 
intuition. When the relevant variables are chosen, 
however, there are formal techniques for deriving the 
higher level dynamics. One such method is the use of 
projection techniques, see the book by Zwanzig J3j 
for a detailed review on this. The classic book by 
Gardiner [T5| is also a good reference on general pro- 
cedures for model reduction in stochastic differential 
equations. Of special interest in this area is the recent 
methods for approximating fast chaotic (mixing) de- 
grees of freedom as white noise through an adiabatic 
elimination procedure, see e.g., ^3'- For a review 
of both inertial manifolds and stochastic approxima- 
tions, see |T7] . 

2.4 Decomposable dynamics 

The techniques discussed in Section 12.11 and 12.21 are 

based on the idea that the dynamics is constrained 



to a low dimensional manifold, which is embedded 
in the full phase space. In contrast, the Langevin- 
type of dynamics, used for dimensional reduction in 
non-equilibrium statistical mechanics, is derived un- 
der the assumption that we know the variables that 
we are interested in and therefore can treat the rest 
of the system either as noise (the fast degrees of free- 
dom) or as an external slaving parameters (the slow 
degrees of freedom). The hierarchical dynamics that 
we are interested in here is different from both these 
approaches. We do not assume that the dynamics has 
an actual dimensionality that is lower than indicated 
by the naive phase space description. The existence 
of constraint, or inertial, manifolds is, as we shall see, 
only a special case. Nor do we assume that we have 
any a priori knowledge of which degrees of freedom to 
focus on for the reduction. The aim is to derive the 
possible projections that reduce the dimensionality 
of a given dynamical system. Finally, a separation of 
time scales is in general not assumed. 

To demonstrate these points let us consider a sim- 
ple situation where we have two independent dynam- 
ical systems, say the Lorenz system and the Rossler 
system, both with parameter values in the chaotic 
regimes. Assume further that we are not presented 
with these system in their "nicest form," i.e., a de- 
composition where the degrees of freedom separate 
into two non-interacting 3-dimensional subgroups. 
Instead the dynamics is described in terms of some 
arbitrary nonlinear combination where all degrees of 
freedom are coupled. Finally, we assume that the two 
systems' time scales are tuned so the recurrence times 
on the respective attractor are comparable, i.e., there 
is no obvious separation of time scales between the 
Lorenz system and the Rossler system. In this situa- 
tion, none of the aforementioned techniques provides 
any hope of dimensional reduction, except perhaps 
to a dimension given by the addition of the respec- 
tive attractors in the underlying systems. The total 
system is truly 6-dimensional. Furthermore, treating 
some degrees of freedom as noise makes no sense. The 
technique presented in this paper is however able to 
decompose the total system into its two "irreducible" 
parts. As outlined in Section ^ a projection that 
eliminates the Lorenz part of the dynamics, results in 
a deterministic dynamics on the higher level, namely 
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the Rossler dynamics, and vice versa. There are two 
different possible projections for the system under 
consideration. The current framework focuses on de- 
composition of dynamical systems. The situation can 
however be asymmetric. Consider a situation where 
subsystem A affects subsystem B, but not vice versa. 
In this case, a projection that eliminates subsystem 
B and results in the dynamics of A is allowed, since 
A by itself is a well defined dynamical system. Elim- 
ination of subsystem A is, however, not allowed since 
B is not an autonomous dynamical system. A more 
technical discussion on these issues is given in Sec- 
tional 

3 Projection Techniques 

We assume that a transition to a higher level can be 
described by a (sufficiently) smooth map tt : M ^ N, 
where N is the target manifold, and rank(7r) = 
dim(iV) = n < m is usually assumed to be constant 
on M. The rank-deficiency guarantees a decrease of 
the degrees of freedom. It is of course trivial to write 
down projective maps n : M ^ N, since any smooth 
rank deficient function works. However, a non-trivial 
restriction on tt enters if we require that the map 
should produce a well defined dynamics on N. By 
"well defined" we mean that the system's time evolu- 
tion can be described in terms of the coarse grained 
variables alone, i.e., the dynamics on the higher level 
is deterministic. Technically we note that since tt 
is a smooth map from M to iV, it induces a differ- 
ential map between the respective tangent bundles 
TT* : TM\^ — » TN\^^^y Since tt is not a diffeomor- 
phism, TT* does not generally define a new vector field 
on N. There is no guarantee that tt{x) = 7r(y) im- 
plies 7r,(v|a;) = •7rH<(v|2^). This means that the induced 
dynamics on N is usually not well defined (not deter- 
ministic). We are interested in the cases when tt ac- 
tually defines a new deterministic dynamical system 
on a higher level. Therefore we make the following 
definition: 

Definition 1 Let tt : M N be a smooth map from 
a manifold M , with dimension m, to a manifold N , 
with dimension n, where n < m. We assume that 
\ is a vector field on M . If the differential, tt* : 



TM\^ —>■ TN\^f^^-^ maps v onto a well defined vector 
field w on N, i.e., w|^^^-j = 7r,(v|^) for all x in M , 
then we call n a projective fiber map with respect to v. 
Furthermore, we define the dynamical system (N, w) 
to be a new (higher) level of description derived from 
(M,v). 

where we let (M, v) denote a dynamical systems in 
terms of a phase space M and a generating vector 
field V. 

The conclusion is that a system allows a higher 
level of descriptions, according to our definition, if 
and only if there exists a projective fiber map with 
respect to the flow (or, to be more exact, the vec- 
tor field generating the flow). Note also that the in- 
finitesimal generators of the dynamics v and w are 
TT- related, see ^Sl for details. 

Assume that tt is a projective fiber map and that 
the two points x and y on M are mapped to the 
same point on TV, i.e., n(x) = 7r(y). The trajectories 
on M passing though x and y must then map onto 
the same trajectory on N, otherwise the dynamics 
on the higher level is not deterministic. We conclude 
that TT{exp{tvx) — 7r(exp(ivy) either for all t, or for 
no t. We use this observation to prove the following 
lemma providing conditions on projective fiber maps: 

Lemma 1 Let n : M N be a .smooth map, and 
V be a vector field on M . Assume further that the 
range of tt is all of N . //7r,(v|^) — 7r,(v|j^) when- 
ever 7r(x) = T^iy), for all x and y in M , then -k is a 
projective fiber map with respect to v. Furthermore, tt 
maps integral curves ofv on integral curves o/7r*(v), 
i.e., 

vr o exp (tv) = exp (t7r*(v)) o TT, \/t. (1) 

Proof; Assume that 

7r(exp(tv)x) = 7r(exp(iv)y) (2) 

for t ~ 0, i.e., 7r(a;) = 7r(j/). We want to show that 
7r»(v|^) — 7r*(v|j^) then becomes a necessary and suf- 
ficient condition for tt to be a projective fiber map. 
A Taylor expansion of Eq[21 gives 

Tr{x) + tv{Tr)\^ + . . . = Tr{y)+tv{TT)\y + ....{3) 
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The higher order terms are irrelevant since successive 
infinitesimal moves on the trajectory can be used as 
initial points for a new expansion to first order. Eq. 
implies VTrj^: = V7r|j^, and since vvrja. — 7r*(v|j;) this 
proves Lemma n □ 

Note that Eq.^ agrees with the diagram in Fig.Q] 
Note also that the proof is very similar to the proof of 
Prop. |n|on symmetries for algebraic equations. This 
is hardly surprising since tt is an algebraic function 
on M. 

3.1 Quotient manifold projection 

A projective fiber map has a non-trivial kernel. Con- 
centrating on the kernel, there is a natural approach 
for constructing projective fiber maps with respect to 
a given vector field. The general idea is to define a Lie 
group action on the manifold M, and then let the sub- 
manifold spanned by the group action define the ker- 
nel of the projection tt. The target manifold N then 
becomes a quotient manifold, i.e., tt : Af — + M/G, 
and the dimensionality oi N i& n = m — k, where 
dim(M) = m and dim(G) — k. A similar approach 
to dimensional reduction can be found in Landi et. 
al. ^ni- There, however, the analysis is restricted to 
Hamiltonian systems. Recall the main properties of 
quotient manifold construction: 

Theorem 1 Let M be a smooth n-dimensional man- 
ifold. Suppose G is a local group of transformations 
which acts regularly on M with s-dimensional orbits 
(through the natural action : G x M ^ M). Then 
there exist a smooth (n — s)- dimensional manifold, 
called the quotient manifold of M by G and denoted 
M/G, together with a projection n : M M/G, 
which satisfies the following properties. 

1. The projection tt is a smooth map between the 
manifolds. 

2. The points x and y lie on the same orbit in M 
if and only if ^{x) — T:{y). 

3. If g denotes the Lie algebra of infinitesimal gen- 
erators of the action of G, then the linear map 
TT* : TM\^ i-^'^ I'^)\tt(x) onto, with 
ker(7r*) = g]^ = {w|^ : w e g}. 




Figure 2: The figure shows a sketch of the quotient 
manifold construction. The gray area symbolize the 
manifold M . The dashed lines represent the orbits of 
the Lie group G, i.e., the fibration. The thick line is 
the resulting quotient manifold M / G. 

The conditions in Lemma ^ need to be transformed 
into conditions on the Lie group G. The global trans- 
formations are hard to address directly. However, 
the infinitesimal generators of the group, i.e., the 
Lie algebra, provide all (local) information about the 
group. The conditions for the quotient manifold pro- 
jection to be a projective fiber map, is therefore for- 
mulated in terms of the Lie algebra g that gener- 
ates the Lie group G, or more precisely the vector 
fields spanning g. Let the vector fields spanning g 
be denoted as {wi}j^-^. From the geometric picture 
of the Lie bracket (see Fig. I^J, we make the follow- 
ing intuitive argument: Let one of the vectors in the 
Lie bracket be the generator of the flow, and let the 
other be one of the generators of g. When the quo- 
tient manifold is constructed, the orbits generated by 
g shrink to a singular point (the point x in the dia- 
gram). For this to be a well defined operation, the 
end points in the diagram in Fig |31 must coincide: 
[w,v] S g. This becomes our condition for the quo- 
tient manifold projection to define a projective fiber 
map. 

Proposition 1 Let y be a vector field on a manifold 
M . Let Q be the Lie algebra g generating a Lie group 
G, with a natural action on M . Then the natural 
projection associated with the quotient manifold vr : 



5 




We then have 



Figure 3: A geometric picture of the Lie bracket. 

M — > M/G is a projective fiber map if [v,g] C g 
everywhere on M . 

The notation [v, g] means the set of vectors fields 
formed by taking members of g and commuting them 
with V. 

Proof: Let vl* : G x M — > M denote a transforma- 
tion group describing the action of G on M, i.e., the 
natural action of G on M. Note that tt{x) ~ T^iv) 
then implies y ~ '^{g,x) for some g ^ G, and the 
projection fulfills 

TT o-^g = TT "ig eG. 

Expressed in terms of the Lie algebra the action of ^E* 
can be written as: 



y 



exp (ew) X, 



for some w g g and e G M. 

Further, we use the Campbell-Baker-Hausdorff 
formula|20| on the form 

exp(v)exp(w) ~ exp(w) exp(w) exp(v), 

where 

1 



w 



[v,w] + - ([w, [w,v]] - [v, [v,v^f]]) 



All the terms in the expansion involves deeper nested 
Lie brackets. From the condition [v, g] C g and the 
vector space property of a Lie algebra, it is then clear 
that w G g. 
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TT [exp(rv) exp(ew)a;] 

TT [exp(e'w) exp(ew) exp(rv)x] 

(tt o g) [cxp(Tv)a;] 

TT [exp(rv)a;] 



for some g ^ G. By this we have shown that -k^x) — 
7r(?/) implies that 7r*(v|^) = 7r,(v|^) for all x and y 
in M. □ 

3.2 Constructing tt from G 

We now describe how to derive the projective fiber 
map corresponding to a set of vector fields that fulfill 
the conditions in Prop.^- By definition 7r(\E'(f/, x)) = 
'k{x) for every element g in G. The function tt is 
therefore G-invariant, which implies 



v^ii-n) = 0, 



(4) 



for all viTi G g. Eq. 0]is usually derived by taking the 
derivative of 7r(exp(ew)a;) = 7r(x), with respect to e 
at e = 0. 

In local coordinates, if w.^ = X]/3=i af? 
constraint can be written as a set of quasi-linear first 
order partial differential equations: 



/3=1 



mix) 



dxP 



= 0, 



(5) 



for i = I, . . . ,k and a ~ I, . . . ,n. To find an explicit 
expression for tt we need to recursively solve this sys- 
tem, using e.g., the method of characteristics. 

The analysis shows that the projection tt consists 
of invariants of the orbits on M generated by G. It 
should be noted that the generator of the flow, v, 
trivially fulfills the requirements in Prop. ^ since 
[v, v] = 0. If we let G be generated only by v, 
however, the dynamics on N is trivial since the tra- 
jectory of the system collapses to a singular point. 
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In this special case, all the components of tt define 
invariants of the flow, first integrals of the system 
that is. The existence of such a tt essentially con- 
stitute the starting point of the study of integrable 
systems. We know that far from all systems are inte- 
grable, i.e., there need not exist n—1 invariants of the 
motion. This brings attention to another important 
point. The partial differential equations defined in 
Eq. ^do not necessarily have global solutions. Local 
solutions near non-degenerate points may not always 
be smoothly extended to global solutions. Determin- 
ing conditions for when they do is indeed a non-trivial 
task, and is beyond the current presentation. The g 
spanned by v construction also demonstrates another 
important technical difficulty in the construction of 
quotient manifolds. Consider, for the sake of the ar- 
gument, a chaotic system with a strange attractor, 
such as the famous Lorenz system. An attempt at 
constructing a new manifold by the quotient E'^ /G, 
where G is generated by v and is the three dimen- 
sional Euclidian space, i.e., the original phase place, 
results in a bizarre manifold. The main problem is 
that the topology of the quotient does not fulfill the 
Hausdorff property. This is clear from the fractal ge- 
ometry of the strange attractor. This observation is 
general, a quotient manifold is not guaranteed to be a 
Hausdorff space. Some more discussions along these 
lines follow in Section 

3.3 Projective fiber maps and symme- 
tries 

A special example of a Lie algebra that fulfills the 
requirement in Prop. ^ is when 

[v,w,] = (6) 

for all Wj G g. This condition actually implies that w 
is an infinitesimal generator to a symmetry group of 
the flow generated by v, see Appendix 1X1 for details. 
We have the the following general result: 

Proposition 2 Let v be a vector field on a manifold 
M . Let Wi be generators of a symmetry group G of 
V, i.e., [v,Wi] =0. Any G -invariant functionn , i.e., 
any function tt such that w.i(7r) = Vi, is then a 
projective fiber map. 



It may seem like the projective maps found through 
symmetry fields only form a subset of all projective 
fiber maps covered by Prop. ^ However the author 
suspects that this may not be the case. For a linear 
dynamics it will be shown later in this paper that all 
projective maps are indeed generated by symmetries. 
An argument for why this should generalize to the 
nonlinear case is currently work in progress. 

3.4 Invariant and inertial manifolds, 
invariants of the motion, integra- 
bility, and Noether's theorem 

In this section we revisit the discussion started in 
Section IT^ We can now understand the relation be- 
tween invariant manifolds, invariants of the motion, 
and projective fiber maps in more detail. We start 
by noting that the existence of invariants of the mo- 
tion is directly related to the existence of an invariant 
manifold. To see this, assume that the invariant man- 
ifold is defined as an implicit sub-manifold, i.e., as the 
solution surface to some smooth constraint function 
F{x) — C, for some constant G that may depend on 
the initial value of the trajectory. By definition then, 
F{x) is an invariant of the motion since the trajectory 
is bound to stay on the invariant manifold. 

How is this related to projective fiber maps? A 
dynamical system with n degrees of freedom and k 
invariants of the motion Fi(x), i — 1, . . . , fc, can be 
transformed into a form where the constraint surface 
is separated from the dynamics. This is achieved by 
making a change of variables where k degrees of free- 
dom are set to yi = Fi{x) i — 1, . . . , fc, and the rest 
of the degrees of freedom are given by arbitrary func- 
tions yk+j = Gj{x), j = 1, . . . , 71 — fc. The only con- 
straint is that the functions Ft and Gj are all func- 
tionally independent. In this situation, a map that 
eliminates degrees of freedom corresponding to the 
constants y^, or any subset of yi for that matter, is 
a projective fiber map. This follows since the dy- 
namics of yk+j is well defined. On the other hand, 
a projection that eliminates yk+j is also a projective 
fiber map since the dynamics of yi is trivial, in fact 
constant yi — 0, and therefore well defined. From 
this argument it is clear that elimination of degrees 



7 



of freedom through invariant manifolds, or invariants 
of the motion, are special cases of projective fiber 
maps, namely cases where there exist projective fiber 
maps onto higher level systems with constant dynam- 
ics y = 0. In this context it is also worth mentioning 
that invariants of the motion are found through pro- 
jective fiber maps exactly when v £ g, or, to put it 
differently, when the v(/) has non-trivial solutions. 
In the special case when v(/) has n — 1 functionally 
independent solutions, i.e., there exist fc = n — 1 in- 
variants of the motion, the dynamical system is often 
referred to as integrable, which means that it can be 
reduced to a system that can be solvable by quadra- 
ture. 

Naively, it may seem like the situation when the 
eliminated subsystem has a trivial dynamic is some- 
how degenerate. The situation is however more gen- 
eral than it seems at first. Consider the rather gen- 
eral situation when the eliminated dynamical subsys- 
tem has a fixed point. Corresponding to that fixed 
point the total system has an invariant manifold, de- 
fined by trajectories starting with a subset of the de- 
grees of freedom at the fixed point of the subsystem. 
Eliminating the subsystem with the fixed point, e.g., 
through a projective fiber map, means projecting the 
dynamic onto the corresponding invariant manifold. 
The stability of the invariant manifold is given by the 
stability of the fixed point. Furthermore, if the elim- 
inated subsystem has many fixed points, each corre- 
sponds to an invariant manifold. Projection onto any 
of these manifolds results in equivalent dynamics on 
the higher level. 

Another important point to discuss is how Corol- 
laryElmay be viewed as a generalization of Noether's 
theorem, see e.g., [H] . Recall that Noether's theorem 
deals with conservative systems in classical mechan- 
ics, or, to be more precise, with system whose tra- 
jectory is defined as a stationary point of an action 
integral, i.e., Lagrange variation principle. For such 
systems, Noether's theorem ensures that, for every 
variational symmetry there exists an invariant of the 
motion. For a detailed definition of variational sym- 
metries we refer to Olver (18) . Key to understanding 
the how Corollary |2] generalizes Noether's theorem is 
to note that in the former the focus is on symmetries 



of the equations of motion^ which is not the same as 
variational symmetries considered in the latter. The 
generalization follows from the fact that every sym- 
metry of the equation of motion is also a variational 
symmetry, but not vice versa. In other words, there 
are more possible symmetries that can generate pro- 
jective fiber maps than variational symmetries that 
lead to invariants of the motion. From the previous 
paragraph we may be a bit more precise: 

Proposition 3 Consider a system whose trajecto- 
ries are defined by variation of a Lagrangian L. A 
variational symmetry of L then corresponds to a pro- 
jective fiber map tt with a trivial higher level dynam- 
ics, i.e., 7r*(v|;j^) = for all x. 

Conversely, let n be a projective fiber map with a 
non-trivial dynamic on the higher level, then the cor- 
responding symmetry of the equations of motion is 
not a variational symmetry. 

The simplest example to illustrate Prop. |3| is per- 
haps two uncoupled harmonic oscillators, see also 
Section lO and lO 

Another interesting situation is when the dynamics 
converge quickly to a submanifold, an inertial man- 
ifold, of lower dimensionality than the total phase 
space. In this case there are usually no exact invari- 
ants of the motion. Still the dynamics of the system 
has fewer effective degrees of freedom than naively 
expected. As discussed e.g., in El E] the exis- 
tence of inertial manifolds can be proven for a wide 
class of dynamical systems, especially in hyperbolic 
differential equations, or, to be more conceptual, in 
driven dissipative systems. Fig. 0] illustrates how in- 
ertial manifolds fit into the framework of projective 
fiber maps. 

4 Illustrative examples 

To gain intuition for the results in the previous sec- 
tion we study three simple, yet non-trivial, examples. 
We start with a linear system. 

^In the variational framework, the equations of motion are 
the Euler-Lagrange equations. 
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Figure 4: The figure is an illustration of the decom- 
position of a dynamical system on a manifold M. 
In this case we imagine that the dynamics revealed 
through the projection tti has a (globally) stable fixed 
point. In this case the dynamics on M is attracted to 
a submanifold corresponding to the dynamics of the 
subsystem given by on This is a special case 
on the inertial manifold picture. In a more general 
situation, the projective fiber map tti would not exist 
since the location of the fixed point would change as 
a function of the location on i-c, the subsystem 
on A^i would be " slaved" to the dynamics of the sub- 
system on N2 ■ If the dynamics on A'^i is fast enough 
to always relax to the fixed point, the system is still 
constrained to a submanifold. This is the general 
picture of an inertial manifold. 

4.1 Linear dynamics 

Start by considering a linear dynamical system and 
a projective map tt of the form: 

X = Ax 
7r(x) = Px, (7) 

where A is an m x m matrix and P is an n x m matrix, 
n < m. The phase spaces are Euclidean: M = R™ 
and R". 

Proposition 4 Consider a linear dynamical system 
and a linear projective map, as defined in Eq. ^ 
Then P describes a projective fiber map if and only 
if ker(P) in A-invariant.^ 

Proof : For pedagogical reasons it is instructive to 
prove the proposition using two different routes. First 

^ By invariance under matrix multiplication we always mean 
left multiplication, i.e., x g kcr(P) implies that Ax G ker(P) 



we simply start by using Lemma^ i.e., we show that 
Px — Py implies tt, (vj^;) = 7r,(v|j,). Later we show 
that Prop, n can be used to arrive at Prop. 0] more 
quickly. 

Route A: Start by noting that linearity implies 

Px = Py <^ x-yekcT{P). 

In the linear case, there is a direct equivalence 
between the base manifold M and the tangent 
space TM\x, which simplifies the differential map^ 
7i'*(v|x) = PAx, therefore 

7r*(vU) = 7r4v|y) ^ A{x -y) EkciiP). 

It follows that ker(P) is A-invariant. 

Conversly, assume that ker(P) is not A-invariant, 
i.e., there exists a 2; G ker(P) such that Az ^ ker(P). 
Take an arbitrary point z' and construct z" = z' — 
z, so that z = z' — z". Now z € ker(P) implies 
Pz' = Pz", but, since PA{z' - z") ^ 0, PAz' ^ 
PAz" . Then, according to Lemma ^ P cannot be a 
projective fiber map. □ 

Route B: Alternatively, we can use Prop.^ Let 
the vector fields spanning g be = wf . Ac- 
cording to Theorem n and Eq. 2]we have 

ker(P) = span(vifi, . . . ,Wfc) . 

Since the condition [v, g] C g simplifies to 

A-Wi = ^fcyWj, (8) 

j 

for some structure constants fc^j, it is clear that 
ker(P) is A-invariant. □ 

4.2 The circle 

We now analyze the simplest dynamical system that 
allows a projective fiber map onto a non-trivial man- 
ifold, namely the circle trajectory corresponding to 

^Remember that the differential is locally defined by the 
Jacobian, and in the linear case the local and global differential 
are equivalent. 
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the linear ordinary differential equation i = Ax given 
explicitly by 



for y 0, and 



X 

y 



-y 



X. 



The system is linear, so naively we might expect 
the analysis in the previous section to be sufficient. 
However, the eigenvalues are purely imaginary ±i, 
and the only linear projective fiber map that can be 
constructed from the eigenvalues is 'k{x) = Px = 
(A — i)(A + i)x — 0. However, by extending our 
searching to more general projections than linear, we 
can find non-trivial projective fiber maps. In practice 
we know that the system is best analyzed in a cylin- 
drical coordinate system, but here we ignore this and 
just apply the machinery "bhndly" Let a possible 
vector field w £ g be explicitly expressed as 

w = r]^[x,y)—+riy[x,y) — . 



Then 



drix , d'qx 



dx 



dy 



Vy 



dx 



dx dy 



d 

"^^d-y- 



The condition [v, w] = gives the two relations 


0. 

It is easy to find a linear solution to these equations: 



drix , dr]j: 

_/Vy^JVy_^^ 
dx dy 



Vx{x,y) = Ax + By 
Vy{x,y) = -Bx + Ay. 

It remains to solve Eq. 0] 

[Ax + Byj — — ^{-Bx + Ay) = 0. 



dy 



Solutions exist whenever at least one of the parame- 
ters is zero: A = 1, B = 0, with the solution 

Tr{x, y) = Fi (x/y) , 



Tr{x,y) 



F2 (y/x) 



for a; 7^ 0, and some arbitrary functions -Fi and F2 
such that -^1(2:) = F2{z) in the domain where both 
functions are defined; and A = Q, B = 1, with the 
solution 

7r{x,y) = G{x^+y^), 

for some arbitrary function G. The last parameter 
configuration corresponds to w = v and the projec- 
tion is onto an invariant of the motion correspond- 
ing to an invariant manifold. The higher level of 
description is in this case trivial, with no time dy- 
namics. Further, it is clear that v, i.e., rotation, is 
a variational symmetry of the system and therefore 
Noether's theorem gives us the conserved quantity 
G{x^+y'). 

The first case is best understood if we chose the 
functions Fi(x/y) = arctan(x/2/) and Fi(x/y) = 
7r/2 — arctan(2//a:), which results in a parametriza- 
tion of the circle by the rotation angle. 

Note that the projective fiber map is defined by two 
overlapping "coordinate charts:" TT{x,y) = Fi{x/y) 
when y ^ 0, and Tr{x,y) — F2{y/x) when x 0. 
The situation with different local coordinate maps 
is generic. The global projective fiber map is con- 
structed from the overlapping local charts, a stan- 
dard procedure for constructing maps between man- 
ifolds. This means that the target manifold, N can 
have a nontrivial topological structure, as in this ex- 
ample when the original manifold M was but the 
projected dynamics takes place on = S*^. The free- 
dom to chose arbitrary functions F and G reflects the 
freedom of a diffeomorphic change of variables on the 
target manifold. 

4.3 General projection of linear dy- 
namics onto the real projective 
plane 

In general, any linear ODE x = Ax has two trivial 
symmetries: v^^i = J^ij and W2 = J2i af"- 

The first symmetry is just the dynamics itself and 
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the corresponding projection maps onto an invariant 
of the motion. The latter symmetry comes from the 
trivial observation that the identity matrix commutes 
with A, but it actually gives a non-trivial projective 
fiber map. In the case of the circle discussed above it 
resulted in a projection onto the rotation angle, i.e., 
S^. In the general case the projection must fulfill 

for all components i. The general solution reads 



For some arbitrary j. Note that tTj is constant. This 
reflects the reduction of dimensionality by the pro- 
jective map. Just as in the case of the circle there is 
no single projective map valid over the entire phase 
space. The projective map provides a "coordinate 
charts" valid in regions where Xj ^ 0. The resulting 
manifold can in fact be identified as the real projec- 
tive plane, PR"^^, if the original dynamics was in 
M". Note that PM^ ~ S^. 



4.4 Subjugated degrees of freedom 

Consider the dynamical system with the following 
nonlinear skew-product structure: 

X = f{x) 
y = 9{x,y)- 

It is clear that a projection onto the first degree of 
freedom, 7r(a;, y) = F{x) for some arbitrary func- 
tion P, is a projective fiber map. It is, however, 
still interesting to see how this reflects in the for- 
mafism. Let v = f[x)-^ + g{x,y)-^ and w = 
?7a,(x,y)^ -t- r?„(a;,y)#-. Then 



[v,w] 



dx ^ dy dx J dx 



d7]y driy 



dx 



9- 



dy 



dg dg\ d 



dx 



Vy- 



and the condition [v, w] = gives two partial differ- 
ential equations 



dri^ dr]^ 

dx dy 

jdriy ^ ^driy 

dx dy 



Of 

''^Tx 

dg dg 

'^^Tx^'^yd-y 



We have the two trivial solutions rj^ — f , rjy — g, 
and Tlx = Vy = 0- Since the flrst equation is fulfilled 
if rjx = 0, independent of 77^, a non-trivial solution 
can be found if 



dx 



9- 



dy 



Vy 



dg_ 

dy' 



(9) 



dyj dy 



and = 0. The exact form of the solution is not 
important since it does not affect the corresponding 
fiber projection. Formally we write 

dnix 

w(7r) = riy{x,y) — ^ — = 0, 

where rjy fulfills Eq. |51 Eq. ^| implies 

7r(x,?/) = F{x) 

for an arbitrary function F(u). This agrees with our 
intuition of the fiber projections existing for system. 
Note that if we try the ansatz r/y = 0, we get the 
equations 

j. dT]x _^ drj^ ^ df_ 
dx ^ dy dx 

-I ^ - 

The last equation implies either: r]^ — 0, which is a 
trivial solution; or that g is independent of x, which 
would mean that the original system separates com- 
pletely and the two degrees of freedom can be studied 
independently. 

As a concrete example, consider the linear case: 

X = ax + y 
y ^ ay 

for some constant a. The matrix governing the dy- 
namics is in itself a non-trivial Jordan block and 
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therefore cannot be diagonalized, or reduced. More- 
over Schur's lemma, usually referenced in matrix rep- 
resentation theory, see e.g., |23i tells us that the 
only matrix commuting with the dynamics are the 
two trivial cases discussed in Section lOl i.e., the 
dynamics itself and ( ■ 1. However, non of these sym- 
metries corresponds to the obvious projective map 
TT{x,y) — G{y). Using the general condition we can, 
however, find a nonlinear symmetry: 

/ ay-xlog|x|\ d 

w = x-F[ — , 

\ ax J ox 

for some arbitrary function F(u), preferably chosen 
so that w is defined everywhere. The result is the pro- 
jective map 7r(a;,y) = G{y), for some function G(»). 

5 Conclusions and outlook 

In this paper we have not dealt explicitly with topo- 
logical aspects of projective fiber maps, except for 
some comments on the map from K.^ to in Sec- 
tion ^21 The general framework for studying these 
aspects is fiber bundles. The process by which we 
eliminate subsystems through projective fiber maps 
is equivalent with the elimination of gauge invariance 
in modern physics. Gauge theory is one of the richest 
fields in theoretical physics, so exploring this connec- 
tion in more detail could clearly lead to interesting 
results in dynamical systems theory. 

Another possible technical complication we have 
avoided is infinite dimensionality. It is well known 
that infinite dimensional systems are intrinsically 
hard hard to analyze. On the other hand, some of 
the most interesting examples of efficient model re- 
duction, especially though inertial manifolds, stems 
from infinite dimensional partial differential equa- 
tions, such as the Navier-Stokes equations. 

We have restricted the attention to continuous 
symmetries. Discrete symmetries, however, are of- 
ten of central importance, especially in mechanical 
systems. For example, permutation of identical par- 
ticles can be used to construct invariant manifolds for 
n-body problems ,22,. Hierarchical dynamics is often 
very prominent in systems with many identical parti- 
cles, for example mono atomic gases. One may spec- 



ulate that this in part is due to the high degrees of 
symmetries in such systems, primarily through per- 
mutations combined with some continuous transfor- 
mation, such as rotations. From these observations 
it seems clear that including discrete transformations 
could be an essential extension of projective fiber map 
techniques. 

It is shown in Prop.|2]that the projective fiber maps 
are directly related to the symmetries of the system. 
A natural question to ask is whether the structure 
of the maximal symmetry group of the dynamical 
system has a natural interpretation in the hierarchi- 
cal organization of the dynamics. We may specu- 
late that irreducible representations of the symmetry 
group corresponds to minimal^ projective fiber maps. 
This line of analysis is work in progress. 

The main limitation of the current framework is 
perhaps the restriction that the dynamics on the 
higher level is required to be deterministic. We know, 
for example from the success of Langevin-type coarse 
graining, that allowing stochastic dynamics on the 
higher levels would greatly extend the applicability 
of projective fiber maps. Naive attempts at imple- 
menting such a scheme, however, result in difficul- 
ties. The main problem is to mathematically define 
strict restrictions on acceptable higher level dynam- 
ics. Currently, it seems to the author that we should 
require the higher level dynamics to be Markovian, 
i.e., the future time evolution should be determined 
only by the current state of the system, not by its pre- 
vious history. This is also in agreement with the con- 
clusions for employing projection operators in non- 
equilibrium statistical physics^, see Zwanzig ^31 for 
details, as well as the argument by Shalizi and Moore 
in 23 . Recasting this requirement into the differ- 
ential geometric perspective given here is currently 
work in progress. 
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^ Minimal in terms of the number of degrees of freedom that 
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^The noise term in the Langovin equation is usually as- 
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A Symmetries of ordinary dif- 
ferential equations 

In this appendix we briefly review the basic theory of 
Lie group symmetries of ordinary differential equa- 
tions. For an extensive treatment of this subject, see 
e.g., • Start by considering a system of algebraic 
equations 

Fk{x) = 0, k^l,...,l, 

in which Fi{x), . . . , Fi (x) are smooth real- values 
functions defined for x on some manifold M. A 
solution is a point x G M such that Fk{x) = 0, 
k ~ 1,...,L A symmetry group of the system is 
a group of transformations G acting on M such that 
G transforms solutions to other solutions., i.e., if x 
is a solution and g a group element in G such that 
g ■ X \s, defined, then g ■ x \s, also a solution. The 
following proposition provides an infinitesimal, hence 
more useful, criteria for a Lie group to be a symmetry 
group: 

Proposition 5 Let G be a connected local Lie group 
of transformations acting on an m-dimensional man- 
ifold M . Let F : AI ^ M.^ define a system of algebraic 
equations Fk{x) = 0, k = 1, . . . ,1, of maximal rank. 
Then G is a symmetry group of the system if and only 

w[Fk{x)] = 0, whenever Fk{x) — 

for every infinitesimal generator w of G. 

Proof: Differentiate F(exp(ev)x) = with respect 
to e at e = 0. □ 

More generally we say that a function F : AI ^ N 
is G-invariant if F{g ■ x) = F{x) for all g £ G for 
which g ■ X is defined. The infinitesimal version of 
this reads: 



Proposition 6 Let G be a connected local Lie group 
of transformations acting on an m-dimensional man- 
ifold M. A smooth function F : M ^ N is G- 
invariant if and only if 

w[F] = 

for all X in AI and every infinitesimal generator w of 
G. 

Note that G-invariance of a function F is a more strict 
requirement than G being a symmetry group of the 
system of algebraic equations F{x) ~ 0. In fact F 
being G invariant is equivalent to requiring that G is 
a symmetry group of the algebraic equation formed 
by every level set {F{x) = c}, c e M'. We will need 
both these formulations later. 

The idea behind symmetry analysis of differential 
equations is essentially equivalent to symmetries of 
algebraic equations, we want to find transformations 
that map solutions into new solutions. Ultimately we 
would like to find criteria of the same type as Propo- 
sition |S1 To achieve this, we first need to define a 
natural geometric setting for differential equations. 
Consider an n-th order system of differential equa- 
tions 

X = ^{t,x), (A-2) 

where ^ : R"+^ R" is a smooth function. A solu- 
tion to Eq. IA-21 is a graph in the configuration space 
= {{t,x{t)) : t € n} C T X AL, where Q. if the 
domain within which Eg. IA-21 is defined. 

A Lie group transformation G acting on T x AI, 
naturally transforms a solution graph according to 

g-r^ = {g-{t,x):it,x)er^}. (A-3) 

To continue we transform Ea lA-2l into a more geomet- 
ric form, i.e., an algebraic relation on some manifold 
structure. For this en we introduce an simplified ver- 
sion of a jet space, which in turn is a special case of 
a fiber space. The first jet space of the manifold M 
is defined as Cartesian product manifold 

M(i) = T X AI X Ml, 

where AI is the configuration space and AIi is a 
space whose coordinates represents the first derivate 
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of functions with domain in T and range in M. Now, 
since t € T, x € M, and x G Mi, Eg. IA-21 comes an 
algebraic equation on M^^\ which we denote as: 



Akit,x,x) = 0, fc=l, 



(A-4) 



The differential equation is now transformed into a 
geometric (algebraic) form. A technical issue remains 
regarding how a transformation acting on T x M acts 
on M'^^\ i.e., the induced action on Mi. As usual 
the analysis can be simplified by considering the in- 
finitesimal generators of the Lie group G rather 
than the global group transformations from Eq. IA-31 
Corresponding to each vector field w over T x M we 
therefore introduce a prolongated vector field pr'^^W, 
defined over M^^\ Symmetry group transformations 
can now be found in terms of prolongated infinitesi- 
mal generating vector fields: 

Proposition 7 Suppose Ak{t,x,x) — 0, k = 
1, . . . , n, is an n-th order system of differential equa- 
tions of maximal rank. Then if G is a local Lie group 
of transformations acting on M , and 

pr(i)w,[Afc(t,a;,i)] = 0, 

wherever Afe(i, a;, i) = 0, fc = 1, . . . , n, and for all in- 
finitesimal generators of G, then G is a symmetry 
group of the system. 

Deriving an explicit expression of pr'^^W as a func- 
tion of w is a somewhat technical matter and be- 
yond the scope of the current presentation (we refer 
to Olver ^2] for details), here we just give the result: 



In this paper we only consider systems of autonomous 
ordinary differential equations. The following propo- 
sition shows the action of the first prolongation of a 
generic vector field in this special case: 



be a wee- 



Proposition 9 Let V — 

tor field generating a flow on a manifold M . The 
action of the first prolongation of some other vector 
field w on the system of ordinary differential equa- 
tions Ak(t,x,x), corresponding to the vector field v , 



£,'^{x) is given by 
pr'-'-^w [x — C(a^)] 



[v,w]|^. 



The following corollary is a direct consequence of 
Proposition |51 and [3 

Corollary 1 Let G be a Lie group, q the correspond- 
ing Lie algebra, and {w^j^L]^ a set of vector fields 
spanning g. A system of autonomous ordinary differ- 
ential equations with a vector field v as infinitesimal 
generator has G as a symmetry group if and only if 



0, 



i — I, . . . , k. 



Proposition 8 Let 



rit,x)— + Y,v"it,x' 



dt ^ ' ' ' 'dx" 

a — 1 



be a vector field defined over T x then the corre- 
sponding first prolongated vector field is given by 

d d 
prWw = r(i,x)- + 5]ry"(t,x)— + 



E 

a, 13=1 

and defined over 



dt ^ ' ' ' ' dx'' 

Q — 1 

.f,drf{x)\ _d_ 
dxP / ai" ' 
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